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Abstract. 

We prove that the scale map of the zero-crossings of almost all signals filtered by the second 
derivative of a gaussian of variable size determines the signal uniquely, up to a constant 
scaling and a harmonic function. Our proof provides a method for reconstructing almost 
aii signals from knowledge of how the zero-crossing contours of the signal, filtered by a 
gaussian filter, change with the size of the filter. The proof assumes that the filtered signal 
can be represented as a polynomial of finite, albeit possibly very high, order. An argument 
suggests that this restriction is not essential. Stability of the reconstruction scheme is briefly 
^■"•^ discussed. The result applies to zero- and level-crossings of linear differential operators 

of gaussian filters. The theorem is extended to two dimensions, that is to images. These 
results are reminiscent of Logan's theorem. They imply that extrema of derivatives at 
different scales are a complete representation of a signal. 
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1. Introduction 



Images are often described in terms of "edges", that are usually associated with the zeros 
of some differential operator. For instance, zero-crossings in images convolved with the 
laplacian of a gaussian have been extensively used as the basis representation for later 
processes such as stereopsis and motion (Marr, 1982). in a similar way, sophisticated 
processing of 1-D signals requires that a symbolic description must first be obtained, in 
terms of changes in the signal. These descriptions must be concise and, at the same time, 
they must capture the meaningful information contained in the signal. 

It is clearly important, therefore, to characterize in which sense the information in an image 
or a signal is captured by extrema of derivatives. 

Ideally, one would like to establish a unique correspondence between the changes of 
intensity in the image and the physical surfaces and edges which generate them through 
the imaging process. This goal is extremely difficult to achieve in general, although it 
remains one of the primary objectives of a comprehensive theory of early visual processing. 

A more restricted class of results, that does not exploit the constraints dictated by the signal 
or image generation process, has been suggested by work on zero-crossings of images 
filtered with the laplacian of a gaussian. Logan (1977) had shown that the zero-crossings of 
a 1-D signal ideally bandpass with a bandwidth of less than an octave determine uniquely 
the filtered signal (up to scaling). The theorem has been extended— only in the special case 
of oriented bandpass filters— to 2-D images (Poggio, et al., 1982; Marr, et al., 1979) but it 
cannot be used for gaussian filtered signals or images, since they are not ideally bandpass. 
Nevertheless, Marr et al. (1979) conjectured that the zero-crossings maps, obtained by 
/•■% filtering the image with the second derivative of gaussians of variable size, are very rich in 

information about the signal itself (see also Grimson, 1981; Marr and Hildreth, 1980; Marr, 
1982; for multiscale representations see also Crowley, 1982 and Rosenfeld, 1982 also for 
more references). 

More recently, Witkin (1983) (see also Stansfield, 1980) introduced a scale-space description 
of zero-crossings, which gives the position of the zero-crossing across a continuum of scales, 
i.e., sizes of the gaussian filter (parametrized by the a of the gaussian). The signal— or the 
result of appiying to the signal a linear (differential) operator— is convolved with a gaussian 
filter over a continuum of sizes of the filter. Zero- or level- crossings of the filtered signal are 
contours on the x — a plane (and surfaces in the x,y,a space). The appearance of the scale 
map of the zero-crossing— an example is shown in Figure 1— is suggestive of a fingerprint. 
Witkin has proposed that this concise map can be effectively used to obtain a rich and 
qualitative description of the signal. Furthermore, it has been proved in 1-D (Babaud et al, 
1983; Yuiile and Poggio, 1983) and 2-D (Yuille and Poggio, 1983) that the gaussian filter is 
the only filter with a "nice" scaling behavior, i.e., a simple behavior of zero-crossing across 
scales, with several attractive properties for further processing. In this paper, we prove a 
stronger completeness property: the map of the zero-crossing across scales determines the 
signal uniquely for almost all signals (in the absence of noise). The scale maps obtained 
by gaussian filters are true fingerprints of the signal. Our proof is constructive. It shows 
how the original signal can be reconstructed by information from the zero-crossing contours 
across scales. It is important to emphasize that our result applies to levei-crossings of any 
arbitrary linear (differential) operator of the gaussian, since it applies to functions that obey 
the diffusion equation. 

Our fingerprints theorems can be regarded as an extension of Logan's result to gaussian 

^ filtered, nonbandpass signals and 2-D images. There are, however, some important 

/""■v differences between Logan's Theorem and the fingerprints theorems. Logan uses a 

bandpass filter, at one scale only, and shows that the zero-crossings determine the filtered 

signal. His proof is non-constructive and only applies in 1-D (2-D generalizations exist 
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Figure 1 The scale map of the zero-crossings of the second derivative of a signal (a 1-D 
slice of a natural image). The x axis is the abscissa; the scale, i.e. a, increases from the 
bottom to the top. Our theorem states that this map is a true fingerprint since it determines 
uniquely the signal (modulus the null space of the operator). 



[Poggio et al,1982] but none are fully satisfactory). The fingerprints theorems determine 
the original image from the zero-crossings of the image filtered at different scales. The 
f*"^* proof is constructive and applies in both 1-D and 2-D. Reconstruction of the signal is of 

course not the goal of early signal processing. Symbolic primitives must be extracted from 
the signals and used for later processing. Our results imply that scale-space fingerprints 
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are complete primitives, that capture the whole information in the signal and characterize it 
^"""^ uniquely. Subsequent processes can therefore work on this more compact representation 

instead of the original signal. 

Our results have theoretical interest in that they answer the question as to what information 
is conveyed by the zero- and level-crossings of multiscale gaussian filtered signals. From 
a point of view of applications, the results in themselves do not justify the use of the 
fingerprint representation. Completeness of a representation (connected with Nishihara's 
sensitivity) is not sufficient (Nishihara, 1981). A good representation must, in addition, be 
robust (i.e. stable in Nishihara's terms) against photometric and geometric distortions (the 
general point of view argument). It should also possibly be compact for the given class of 
signals. Most importantly it should make explicit the information that is required by later 
processes. Fingerprints of images may have these additional properties. Their compactness 
property, for instance, can be defended with the same type of heuristic arguments used to 
justify edge detection. 1 

2. Assumptions and results 

We consider the zero-crossings of a signal I(z), space-scale filtered with the second 
derivative of a gaussian, as a function of x, a. Let F and E be defined by 

E{x,o) = ^UG 

E{x,a) = I(x)*~{G(x,a)} = j I{s)^~txp-^ds. [2.1] 

Notice that E(x, a) obeys the diffusion equation in x and a\ 

d 2 E IdE 



f*s_ 



dx 2 a do 



[2.2] 



We restrict ourselves to images, or signals, P such that E can be expressed as a finite 
Tayior series of arbitrarily high order. Observe that any filtered image can be approximated 
arbitrarily well in this way. 

We will show that the local behavior of the zero-crossing curves (defined by E(x,a) = 0) on 
the x — a plane determines the image up to an harmonic 2 function ip(x), such that -£^ip — 0. 
The proof of this result will then be generalized to 2-D. We will also discuss its (obvious) 
extension to zero- and level-crossings of linear (differential) operators. More precisely we 
will prove the following theorem: 

Theorem 1: The derivatives (including the zero-order derivative) of the zero-crossings 
contours defined by E(x, a) = 0, at two distinct points at the same scale, determine uniquely 

1 Clearly, the scale map fingerprint cannot always be a more concise description of the signal than 
the signal itself, unless the signal is redundant in precisely the way that the fingerprint representation 
can exploit. We expect this to be the case for images, if an appropriate differential operator is 
used, because images are not a purely random array of numbers. Usually images consist of rather 
homogeneous regions that do not change much over significant scale intervals. 

2 This indeterminancy is not a problem. It has long been known thai the human visual system is rather 
insensitive to linear illumination gradients. Our reconstruction scheme provides the Laplacian of the 
image / in terms of Hermite polynomials. It is easy to integrate a function of this type to obtain /. 
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a signal of class P up to an harmonic function of x and constant scaling (except on a set 
/f*y of measure zero)} 

Note that the theorem does not apply to signals that do not have at least two distinct 
zero-crossings contours. Another remark is relevant here: the gaussian filter seems critical 
for our proof, but we cannot show that it is the only filter with this property, In section 4 
we will extend Theorem 1 to the two dimensional case: 

Theorem 2: Derivatives of the zero-crossings contours, defined by E(x,y,o) — 0, at two 
distinct points at the same scale, uniquely determine an image of class P up to an harmonic 
function of x, y and a scaling factor (except on a set of measure zero). 

if the signal is not a polynomial, a similar weaker result can be proved. 4 A best solution 
can always be found but it may not be unique. These theorems break down when all the 
zero-crossing contours are independent of scale (i.e. the contours go straight up in the 
scale-space fingerprint). This is a rare, though interesting, special case and is discussed 
in detail in a future paper [Yuille and Poggio 1983, in preparation]. It can only occur for 
functions which cannot be represented as finite polynomials. 

The theorems do not directly address the stability of this reconstruction scheme. The first 
question concerns stability of the reconstruction of the filtered function E(x,c) at the a 
where the derivatives are taken. Note that our result relies only on two points on the 
zero-crossing contours. Exploitation of the whole zero-crossings contours should make 
the reconstruction considerably robust. The second question is about the stability of the 
recovery of the unfiltered signal V 2 I(x) from E{x,c). This is equivalent to inverting the 
diffusion equation, which is numerically unstable. Reconstruction is, however, possible with 
an error depending on the signal to noise behaviour (see later). 5 

2.1. Outline of the 1-D Proof 

fs We summarize here the 1-D proof from a slightly different point of view that clarifies its bare 

structure. 

The proof starts by taking derivatives along the zero crossing contours at a certain point. 
Such derivatives split into combinations of x and t derivatives (where t — cr 2 /2). Because 
the filter is assumed to be gaussian, however, derivatives can be expressed in terms of x 
derivatives. This is a key point: since the filtered signal E(x, t) satisfies the diffusion equation, 
the t derivatives can be expressed in terms of the x derivatives simply by E t = E xx . The next 
stage is to find the x derivatives of E(x, t) up to an arbitrary degree n from such derivatives 
along the zero crossing contours in the x — t plane. We show that this can be done by 
using 2 points on 2 contours. (It is possible that one point is sufficient, but we are as yet 
unable to prove this.) Since E(x, t) is entire analytic, because of the gaussian filtering (see 
Appendix 2), it can be represented by a Taylor series expansion in x. Since we know the 
values of the n derivatives of E(x,t) with respect to x, we know its Taylor series expansion 
and hence E{x,t). The unfiltered signal F(x), (E(x,t) — F(x)*G(x,t)) can then be recovered 

3 For a general operator the reconstruction is modulus the null space of the operator. Harmonic 
functions are the null space of the Laplacian. 

4 In this case, the signal is determined by the zero-crossing contours in the L 2 sense only. This 
means that the signal may not be determined correctly on a set of measure zero. However, if the 
image is assumed to be an analytic entire function (see Appendix 2), section 3.4 implies that it can be 
determined exactly everywhere. Since images - like any physical signal - are effectively bandlimited by 
the measurement (or imaging) process, they can be considered as restrictions to the reals of analytic 
entire functions (see Appendix 2). 

5 lf E(x,<f) is obtained at all a - this can be done by applying the reconstruction scheme at two 
points at each a - robust reconstruction of I(x) can be achieved in the following way (Hummel and 
j*^ Zucker, in prep.). Since / E(x,t)dt == f(I*G) :rx dt = J(I*G),dt — E(x,Q) with the integration between 

and oo, I(x) can be reconstructed by integrating E(x,a) across a (with t — a 2 /2 the diffusion 
equation is E x x = E t ). In practice, the limits of integration will be finite, originating small errors in the 
reconstruction. 
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in the ideal noiseless case by deblurring the gaussian. A particularly simple way of doing 
/*^ this is provided by a property of the function <f> n in which we will expand the function F; the 

coefficients of an expansion of F(x) in terms of <j>„ are equal to the coefficients of the Taylor 
series expansion of E(x,t). In the presence of noise, the recovery of F(x) from E(x,t) is 
obviously unstable. It is limited by S/N ratio since high spatial frequencies in the signal are 
masked by the noise for increasing t. (For instance, if F(x) — J2 a u ei>lx > tn e filtered signal 
is E(x,t) = £a M e ! '"e~V.) Note that since the zero-crossing contours are available at all 
scales a reconstruction scheme that exploits more than 2 points will be significantly more 
robust. As one would expect, the reconstruction of the unfiltered signal is therefore affected 
by noise. The reconstruction of the filtered signal E(x,t) is likely to be considerably more 
robust. We plan to study theoretically and with computer simulations the noise sensitivity of 
the reconstruction scheme. 

3. Proof of the Theorem in 1-D 

We divide our proof into three main steps. In the first we show that derivatives at a point on 
a zero-crossing contour put strong constraints on the "moments" of the Fourier tranform 
of E(x,a) (see eq. 3.1.4). The second section relates the "moments" to the coefficients of 
the expansion of F(x) = E{x,0) in functions related to the Hermite polynomial. In the third 
section we show that the "moments" can be uniquely determined by the derivatives on a 
second point of a different zero-crossing contour. 

3.1. The "moments" of the signal are constrained by the zero-crossing contours 



if*\ 



Let the Fourier tranform of the signal I(x) be I(w) and the gaussian filter be G(x,a) — ^t~£r 

p**. with Fourier transform G(u) — e~V . 

The zero crossings are given by solutions of E(x,t) = 0. Using the convolution theorem we 
can express E(x, t) as 

E(x, t) = J e- w V w V/(a;)dw. [3.1.1] 

and t = a 2 /2. The Implicit Function theorem gives curves x(t) which are C°° (this is a 
property of the gaussian filter and of the diffusion equation, see Appendix 2 and Yuille and 
Poggio, 1983). Let ? be a parameter of the zero crossing curve. Then 

d dx d dt d , 

— — __ j_ __. 3.1.2 

d? d^dx d{dt l J 

On the zero-crossing surface, E — and -jj^E — for all integers n. Knowledge of the 
zero crossing curve is equivalent to knowledge of all the derivatives of x and t with respect 
to?. 

We compute the derivatives of E with respect to ? at {x ,t ). The first derivative is : 



~E(x,t)=^ / e -«V WI (u^ 2 J(wWw 
a? of J 

+ * [ e-^-^y^^lMdu 
a? J 



and is expressed in terms of the first and second moments of the function e~ w2t e 1W3: w 2 /(w). 
The moment of order n is defined by: 
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/oo 
(*w) n e - u2 V"*u, 2 /( w )dw. [3.1.4] 



The second derivative is 



+ j| / e- wat (- w 2 )e' w * w 2 I( w )dw 



+ (f) J e ~ W,tei " X (-" 2 yi(")du [3.1.5] 

+ 2 TfI e ~ w2t (-w 2 )e !WI (^)a; 2 /(a;)d W 



Since the parametric derivatives along the zero crossing curve are zero, equation [3.1 .3] is a 
homogeneous linear equation in the first two moments. Similarly, [3.1.5] is a homogeneous 
linear equation in the first four moments. In general, the n th equation, ^E(x,t) = 0, 
is a homogeneous equation in the first 2n moments. We choose our axes such that 
x = o. The next section shows that the moments of e-" ;2( w 2 /(w) are the coefficients a„ 
in the expression of the function F(x) in Hermite polynomials. So we have n equations 
in the first 2n coefficients o„. To determine the a n uniquely, we need n additional and 
independent equations which, as we will show in section 3.3, can be provided by considering 
^—^ a neighboring zero crossing curve at (ii,t ). 

3.2. The "moments" are the coefficients of the expansion of F(x) 

In this section we show that the moments defined by [3.1 .4] can be related to the coefficients 
of the expansion of F(x) in functions related to the Hermite polynomials. We expand 

F(s)=^/(s) [3.2.1] 

in terms of the functions <p n (x,cr) related to the Hermite polynomials H n (x) (see Appendix 1) 
by 

< Pn {x, a) = (-1)" ffW ~ 1 H n (—) [3.2.2] 

F ( x ) = J2 a n (a)<p n (x,a) [3.2.3] 

n=0 

The coefficients a n {a) of the expansion are given by 

a n {a) = (w u {x, a), F(x)) [3.2.4] 

where (, ) denotes inner product in I? and {w n {x, o)} is the set of functions biorthogonal to 
{ip n {x,a)}. The {<p n (x,o)} are given explicitly by 

a 2n— ' jj" ' d n -x 8 
<p n (x,<?) = — — _ e £i _ e ... [3.2.5] 



r\ 
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and the w n [x,a) by 



w n {x, a) = (~l) n -— e lfr [32.6] 



Since 



the a n are given by 



F( x ) = — J e ib "u 2 I{u)du 
V2w J 



V27T J aX 



[3.2.7] 



[3.2.8] 



The inner product in [3.2.8] is just the inverse Fourier transform of w n (x): Therefore, 

a n (a) = J {iw) n e = ^ sl u 2 I{w)du [3.2.9] 

which is equal to M„ modulus a factor e wx . We will need to consider the derivatives along 
the zero-crossing contours at two points. We can choose coordinates so that these points 
are (0,cr ) and (ii.oo). 

Therefore knowledge of the image is equivalent to knowing the o n . 
3.3. Combining information from two contours 

The derivatives at {xi,t„) give us n equations in the first 2n moments of e~ w2 'e' WI1 w 2 J(w). 
We can relate them to the expansion coefficients of the function 



F[x + atO = J e iux e iuXi uj 2 I{u)du 



[3.3.1] 



in terms of the <p n functions. 
We write 



2n 



F{x + xi) = ^2 b n<Pn(x) [3.3.2] 





We have n equations for the 2n unknowns 6„. Now observe that 



2r» 2n 

I 





Y^ l>n<Pn{x) = J2 a n<Pn{x + Xi) [3.3.3] 



Any tp n (x + xj) can be expressed as a linear combination of <p m (x) with m < n, as we will 
show in section 3.3.1. 

^m^ Thus we express each 6 n 's in terms of a„'s and then we combine the equations from two 

points to obtain 2n equations for the 2n coefficients o„. Thus with the results of the next 
two sections the proof will be complete. 
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3.3.1. Change of basis 

For a given a, the functions ip n are given in terms of Hermite polynomials (see eq, 3.2.2). 
We show how we can express Hermite polynomials with origin at x — in terms of Hermite 
polynomials with origin at x = —x x and hence perform a change of basis. 

We show that H n {x — x t ) can be expressed as a linear combination of H n (x) with m < n. 
Let us consider the generating function e ~ p2+2px which defines the Hermite polynomials as 



e -P s +2p* = £ ^m p n [3.3.1.1] 

n=0 

Equation [3.3.1.1] gives at x + n 

e -p'+ap(«-» = V* g n(»-»i) p » [3 g ! 2] 

n=0 " ! 

The left hand side of equation [3.3.1.2] can be expanded as 

e _V +2pie _ 2pil = A flnfe) y* (-2*) m P m [3.3.1.3] 

~; n! *-' m! 

n=0 m— 

Term by term comparison of equation [3.3.1.2] and [3.3.1.3] gives 

H n (x - *i) = £ ( " )H m (x)(-2 Xl ) n - m [3.3.1.4] 

The series obtained by substituting equation [3.3.1.4] into 

oo 

f{x) = J^b n H n {x- Xl ) [3.3.1.5] 

n=0 

is a series of the form 

.00 

X) d nHn(x) [3.3.1.6] 

n— 

that converges to f(x) as the following argument demonstrates. If f(x) is in L 2 it can be 
expanded in terms of the H n . Similarly, g(x) = f(x — xi) is also in L- and can be expanded 
as 

oo 

g{x) = £ c„ff B (s) [3.3.1.7] 

n=0 

Thus, /(z — .ti) can be expressed as a linear combination of H v (x) and this series coincides 
with eq. (3.3.1. 6) because of the uniqueness of the expansion. In particular, we obtain for 
thep„ 

<p„(x — x u t) — <p n (z,t) + xi<p n - 1 (x,t) + ... [3.3.1.8] 

where the remaining terms are functions <p m [x,t), with m < n— .1, multiplied by polynomials 
in xi. 
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Observe that if we restrict ourselves to polynomial functions of x a change of basis will 
correspond to transformating an n-th order polynomial in % into an n-th order polynomial 
in x — x\. This argument suffices for our theorems which are restricted to finite polynomial 
functions of class P. For the sake of completeness, however, Appendix 3 deals with the 
general case. 

3.4. Independence of the equations 

We have to show that information from 2 points yield a unique solution. The first n equations 
in the 2n first moments from a point can be written as 



f**\. 



'% % 

& $ + {%) 2 2fe$ (f) 2 



f M x (x)\ 
M 2 {x) 

K M 2n {x)) 



(3.4.1) 



The matrix of the coefficients is a nx2n matrix. Note that its rows are linearly independent 
(since the coefficients of the r ih row vector are zero after the 2r th component). 

The next n equations are given by the matrix of the derivatives at a second point, x i} that 
have the same form as eq. (3.4.1), multiplied by the moments at (x + x{). 




i 2 -I s£l _j_ 



2f$ 



fM 1 (x + x 1 )\ 
M 2 {x + k 1 ) 

\M 2n {x + xi)) 



= 0. 



(3.4.2) 



The moments at (a + x t ) can be expressed in terms of the moments at x by the following 
transformation (see section 3.3). 



/—\ 
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Zl 
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xi 








1 



IT 



Xi 



27iT 



1 J 



( M x {x) \ 
M 2 {x) 

\M 2n {x)) 



[M 1 (x + x 1 )\ 

M 2 {x + x\) 

M 2n (x + X X )} 



(3.4.3) 



Equation (3.4.3) substituted into (3.4.2) gives, together with equation 3.4.1, the full set of 2n 
equations in the 2n unknowns M,(x). The 2n x 2n matrix of the coefficients can be thought 
of as originating from the first point (the top half) and from the second point (the bottom 
half) on the zero-crossing curves. 

In general, the determinant of this matrix is non-zero. Intuitively, if the filtered signal has 
nonzero moments of order higher than 2n, the system of 2n equations would not have a 
solution. A proof for this claim is given in Appendix 4. The argument is based on the fact 
that the determinant of the coefficients is a polynomial in ij. If this vanishes, then x x can 
be expressed in terms of the first n derivatives at the two points. We show, however, that 
in general it is possible to change % continuously without altering the first n derivatives. 
This implies that the determinant is almost always different from zero. The argument breaks 
down if the filtered signal is a polynomial of degree 2n or less. 

In this case, the determinant must be zero, since the homogeneous set of equations has 
at least one solution. At this point, we have to show that the solution is unique. We first 
observe that the determinant of the coefficients of the 2n x 2n system of equations is a 
polynomial in x } . This polynomial is nontrivial 6 since the first n and the second n equations 

6 This argument cannot be applied when all zero-crossing contours aie vertical straight lines: in this 
case it is impossible to reconstruct the signal [Yuille and Poggio 1983, in preparation] 
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separately are independent. It follows that the determinant vanishes at a finite number (at 
f~\. most 2n) of values of %\. 

Suppose the determinant is zero. Observe that x x is known from the position of the zero- 
crossing curves (xi is the distance between the two points at which derivatives are taken). 
Typically the roots of the polynomial in x K will be distinct and there will be a unique zero 
eigenvector of the matrix. Thus we have proved that n derivatives at two points determine 
uniquely (modulus a common scaling factor) the 2n moments of a polynomial of degree 2n. 
The case of multiple zero eigenvectors is nongeneric, i.e., an arbitrarily small perturbation 
in the "image" would annihilate eventual multiple zero eigenvectors. Furthermore, multiple 
zero eigenvectors of the matrix of degree 2n must also be multiple zero eigenvectors of all 
higher order matrices which is even more unlikely (except on a set of measure zero). 

Our proof is limited to filtered function of the polynomial type (albeit of very high degree). 
We now stretch an argument suggesting that the result holds also for most filtered functions 
E(x, y) which are not polynomials. 

Consider the homogeneous system of equations obtained from two points up to the moment 
M 2 „. Denote with A 1 the matrix of the coefficients. Let A be the matrix of the coefficients of 
the inhomogeneous system of equations obtained by dividing all unknowns M x to M iN by 
the first moment. The system, AM' — Z, where Z is the first column of A! divided by M x , 
does not in general have solutions as we have shown (see Appendix 4). Furthermore, A 
has no null vector (if it has, then A' must also have a null vector, which is impossible since 
detA' ?£ o.). Then there is a unique least square solution of the equation \\AM' — Z\\ = 
given by M' — A + Z, where A + is the pseudoin verse of A [see Albert, 1972]. Thus for every 
finite M there is a unique least square solution to the system of equations AM' = A but no 
exact solution. As n goes to infinity, however, at least one exact solution must appear. 

^^ To summarize, in section 3.1 we show that the moments of the signal are constrained by the 

'^ derivatives of the zero-crossing contours at one point. Section 3.2 shows that the moments 

are equal to the coefficients of the expansion of the unfiltered signal F(x) in our Hermite-like 
expansion (and also equal the coefficients of the Taylor expansion of the filtered signal 
E(x,t)). in section 3.3 we show how we can combine constraints from two different points 
on the zero-crossing contours at the same scale. Finally, section 3.4 demonstrates that the 
equations obtained in this way from two points determine a unique solution. The stability of 
the solution was briefly discussed in section 2. 

4. The Extension to Two Dimensions 

The function 

F(x) = E{x, 0) = / e^-V/(w)dw (4.1) 

can be expanded in terms of the <p n (x, t) and ^„(y, t) as 

F (Z) = £ a *m(t)<Pn(*, t)<Pm(y, t) (4.2) 

n,m 

with the coefficients given by 

/"•S <W(*) = (^(z), v>n(x, t)w m {y, t)) = J (iwj"(iw !/ )' n e ~^ ( %)dw. (4.3) 

We define T[w) as 
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O T(«) = e^% 2 %) e -^ ( 4 . 4 ) 

and 

£(z, i) = / T{w)du. (4.5) 

We now take derivatives of E(z, t) on the zero-crossing surface. Thus with 



r*^ 



_d _ di_a_ dy _a_ dt a 

df ~ df 3a; dfSy df5f 



the first equation 



d f = 



gives 



(4.6) 



dE „ 



gives, where w = (w I ,Wy) = (w 1 ,w 2 ) and w 2 = w Ji 2 + w tf 2 , 

^ y UxT{w)dui +J- J u y T{ui)dw + j- J w 2 T(w)dw = (4.8) 

and the second equation 



d 2 »? 
/-\ -j-2 = (4.9) 



(4.10) 



— f^T^duj+^I^T^dut 
dxi dxj f 

+ *$■%/ *mW* 

where we use the summation convention over i,j, 

These equations, and the higher order ones that can be obtained in the same way, are 
equations in the moments S rnpq where 

S mpq = J w 2 'X^r(w)dw. (4.11) 

The n-th order equation will consist of terms of the type S mpq with m + p + q < n. We will 
show that, using different curves on the zero-crossing surface through [x ,y a ,t ), we can 
produce one equation for each pair of moments with m-\-p + q = n in terms of the moments 
with m + p + q < n. As in the 1-D case we have half the equations we need to solve for 
the moments. Again we can consider a second point on another zero-crossing contour (at 
the same scale). Combining the equations from two points, after a change of basis, yields 
enough information to determine the image. 
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There are an infinite number of curves on the zero-crossing surface which pass through 
f*S any given point {x ,yo,ta). Since the surface is two-dimensional, the tangents to these 

curves form a two-dimensional vector space. Each curve will give different equations for 
the moments. We will show that by taking different curves through the same point (zo,yo,*o) 
we can nearly obtain enough linearly independent equations to determine the moments. 
As in the one-dimensional, case we show that we can obtain the remaining information by 
considering the behaviour at a second point on the zero-crossing surfaces. 

We first consider the lowest order equation (4.8). As we mentioned above there are two 
linearly independent tangents to the zero-crossing surface at (x ,yo,t ). Thus we have 
two linearly independent vectors (^-, j^, ^-) and (^-, j^, £- % ) where we use ?i and f 2 to 
denote the parameters on the two curves. We can substitute these vectors into equation(4.8) 
and obtain two equations for three unknowns (the three moments with n = 1). These are 
sufficient to determine the moments up to a scaling factor. This factor corresponds to 
scaling the image I and cannot be determined from the zero-crossings. 

We now consider the n-th order equations and show that there is one equation for each pair 
of moments with p-fg-f-m = nin terms of the moments with p + q + m < n. The moments 
we need to solve for are the S mpq with m + p -+- q — n. Fix m and consider the moments 
as p and q vary. There are n — m -f 1 possible moments, however we will show that only 2 
of them are independent. The moments are given in equation (4.11). Adding the moments 
S m ,p,g and Sm, P +i,q-2 gives us the moment S m +\, P , q -2- Now, since m + p + q = n, we find 
(m + 1) + p + {q — 2) = n — 1 and so the moment 5 m+ i, p ,,_ 2 is of order n — 1 . Thus if 
we know S m , p , q we also know S m ,p +2 , ? — 2- We can repeat this argument adding 2 to p and 
subtracting 2 from q or vice versa. Thus if we know the moments 5 m , ,„_ m and S mtltn — m —i 
we can use this argument to find the other moments. Hence for each value of m there are 
only 2 independent moments. The case m = n is special and only has one term, m can 
/"•^ vary from to n and so there are a total of 2n + 1 independent moments with m-fp-fg = n. 

We show that for each m it is possible to get one equation for the two moments. 

The coefficients of the unknowns will be A pqm where 

evaluated at x ,yo,t and thus the expansion containing the unknowns is of the form 

/ 4 A. m pqS m pq V*-13) 

m,p,q 

We consider now the terms for a fixed n. Since we can take the derivatives along arbitrary 
directions on the surface, the terms dx/d; and dy/d$ take independent values (while dt/d$ 
is constrained since the curve must lie on the zero-crossing surface). We will show that it 
is possible to eliminate all the new moments (those with m + p + q = n) with m > and 
obtain one equation for the two independent moments with m = 0. In a similar way we 
can get one equation for the two independent moments with m = 1 and so on. First we 
eliminate the moment with m — n. We consider N curves with parameters {si,(2,---Sn)- We 
normalize the curves by requiring 

■£ = l,i = l > 2,...JV (4.14) 

This is always possible unless we are at an extreme of the zero-crossing surface. Suppose 
we write down the n-th order equations corresponding to two different curves. From 
equations (4.12) and (4.13) the coefficients of 5 n , ,o are unity in both cases. Thus we can 
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subtract one equation from the other and obtain a linear equation for the new moments with 

m < n. 

Now we show we can eliminate the m = n and m = n — 1 moments simultaneously. We 
take three curves with parameters fi,f2>?3 and add the three resulting nth order equations 
multiplying the first by X the second by jj. and the third by ;/. Comparing coefficients of 
S n ,o,o< Sn— 1,1,0 and S„._ lj0) i gives us three simultaneous equations 



X + fJL + V = 0, 



(4.15) 



, dx dx dx 

dfi df 2 "?3 



(4.16) 



.dydydy 

o?l "f2 o?3 



(4.17) 



These can always be solved since the tangent vectors (i.e the vectors (1, ^, ^-)) form a two 
dimensional vector space and hence any three vectors in this space are linearly dependent 
and satisfy equations (4.15), (4.16) and (4.17). Note that if two curves are the same we 
can satisfy these equations but the resulting equation for the moments will vanish. Let 
the normal to the zero-crossing surface be (ni,n 2 ,n 3 ). Then the curves must satisfy the 
equation 



j <"* , "\ 



dx dy 

"i +"2-r- +n 3 — = 
df, dfi 



(4.18) 



So we can only vary one of jf: and ^- independently. 

Now we try to eliminate the moments with m = n, m = n — 1 and m = n — 2. We combine 
the n-th order equations from curves with parameters fi multiplying the equations by X< 
and taking the sum. The coefficients of the moments 5 n , ,o, S^— i,t,o> 5 n _i,o,i, S n _ 2 ,2,o ar) d 
5"n-2,i,i (using S n - 2 ,o,2 = S n -i i0 ,o — S n -2,2,o, where 5„_ li0 ,o is a lower order moment) form 
a vector k 



1 



dx 
dU 

f 

377 377 
V ^3% J 



(4.19) 



where, for simplicity, we have incorporated the factors of n into the moments. To eliminate 
the moments with m > n — 2 we must solve 



E^=°- 



(4.20) 



t=i 



.^"N 



Because of equation (4.18) there are only three linearly independent vectors which can be 
formed by varying the $f- and taking linear combinations. Thus if A r — 4 we can solve 
the equations (4.20) and eliminate moments with m > n — 2. By increasing the number 
of curves by 1 each time we decrease m by 1 we can eliminate all the moments with 
m > 1. We are left with one equation in the two unknown moments with m — 0. In a 
similar way we can eliminate all the moments except the two with m — 1 and obtain one 
equation for these two moments. We repeat this process for the higher order moments. 
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Thus the n-th order equations give us one equation for each pair of independent moments 
^*s. with p + q + m = n. if we consider all the equations as n varies we find that, as in the 1-D 

case, at each point on a zero-crossing contour we have only half the number of equations 
needed to solve for the moments. As in the one-dimensional case we now consider a 
second zero-crossing surface at the same value of t and repeat the argument. We change 
the basis of the Hermite polynomials as in section 3.3 and obtain enough equations to solve 
for the moments. Substituting these into the equation (4.2) for F(x) completes the proof of 
Theorem 2. 

5. Examples 

We now illustrate the theorems by considering some special cases. If the signal is a low 
order polynomial in X, it is possible to obtain the zero crossing curves explicitly. We then 
use the derivatives of these curves to reconstruct the image, as in the theorem. These 
examples also suggest that the derivatives of the curves at a single point will usually give 
sufficient information to reconstruct the signal. 

Suppose the signal F(X) is a second order polynomial in X. 

F(X) = 1 + AX + BX 2 (5.1) 

where A and B are arbitrary coefficients. All the moments of the signal are zero except for 
the first two. We convolve this signal with a gaussian at scale a and obtain 

E{X,a) = l + AX + BX 2 + B<T 2 (5.2) 

We consider the curves given by 

E{X,a) = (5.3) 

We write these in the form 

a 2 + {X 2 + {A/B)X + 1/ B) = (5.4) 

and see that they correspond to circles in the (X, a) plane. Define Xi and X2 by 



f~*s 



^ m s. 



X X X 2 = 1/5 
-(X 1 +X 2 )=A/B 



(5.5) 



Then we can rewrite the equations as 

°* + { x - (^T^)} 2 = (^T^) 2 (5 - 6) 

Thus the zero crossing curve corresponds to a semi-circle which intersects the X-axis at 
Xi and X 2 (see figure 2). 

We now parameterize the curve by an angle $ so that 






(5.7) 
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/""% 



f~^ 




Figure 2 See fexf. 



/*■% 



We calculate the derivatives 



dX (X 2 -X 1 \ . . 

d? = (-T- r 9 



Recalling that t = a 2 /2, we combine (5.7) and (5.8) to obtain 



dt fXt-XA* . 



nOcoaO 



We differentiate again to obtain 



d*X ( X 2 -X l \ . 
~dW = -{—2—) coa$ 
dh [X2-XA 2 . . , 

W^\~2—) {cOSd - Sm9) 
We set x *7 jY ' = 6. Then we write the first two equations at 6 = 9 X as 



(5.8) 



(5.9) 



(5.10) 
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-bsin$i b 2 sin6icos6i 

-bcosOx b 2 cos 2 $i —2b i sin 2 8xCos6 1 b i sin 2 0icos 2 9 



/MA 

—bsindi b 2 sin9icos0i \\ M 2 1 (0\ /- 11N 

JU.rU (5 - n) 



We pick another point on the curve with the same value of c This point has parameter 
6 2 = tt — 6 1 (with < 6 2 < tt/2). This gives us a second equation 



M 2 
M 3 



-©■ 



/ , Jl X, ? X?/3f\ 

/ — 6am#i — b 2 sin9\cos9\ \ 1 Xj X 2 /2\ 

\bcos0! 2cos 2 $i 2b 3 sin 2 9 1 cos 2 9 1 b i sin 2 9 1 cos 2 9 1 ) rj 1 xl 

VO 1 A M 4 

(5.12) 

Now we consider the equation for the first two moments obtained by taking the first derivative 
at both points. From (5.11) and (5.12), this becomes 



— bsindi b 2 sin$iCOS$i VMA /0\ /_ ..o\ 

—bsin$i —b 2 sin9icos9i—Xibsine 1 )\M 2 )~~\o} l ' ' 

The condition for there to be a solution of (5.13) is that the determinant of the matrix 
vanishes. This occurs at 

X l =■ -2bcos$ 1 (5.14) 

f*^-. From (5.7). we see that this is indeed the distance between the two points and so we can 

solve for Mi and M 2 . We obtain: 

Mi = bcos9 1 M 2 (5.15) 

Substituting for bcos9i from (5.7) yields 

tfi"(*c-p-±^})*a (5-16) 

where X is the position of the first point. The reconstructed function is 

F(X) = -M&iiX-Xo.tn) + M 2 <p 2 (X-X ,ff) (5.17) 

Without loss of generality set X — 0. Then up to a scale factor 

F(X) = {Xl + X2} * + -M-* + ^} (5-18) 

2 VSht, 2x/2lr I CTl J 

Now <7j lies on the circle 

^N at the point where X = 0. Hence 

erf = — XjJf 2 (5-20) 
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Note that Xi and X 2 have opposite signs if X = lies on the circle. Substituting (5.20) into 
f*^. (5.18) gives 

F (X) = 1 {XiX 2 - (X, + X 2 )X + X 2 } (5.21) 

2y/2^^-X 1 X 2 

From (5.1) and (5.5), we see that this is indeed the original function up to a scaling factor. 
Thus we have demonstrated how to reconstruct the signal. 

We should check that X x — —2bcos0 1 remains a root of the determinant for the higher order 
determinants. We will calculate the result for the case n = 2. From (5.11) and (5.12), the 
determinant equation becomes (in unconventional notation) 

f—bsin9 1 b 2 sin6icos0i "\ 

—bcosGi b 2 cos*0i — 26 3 at'n 2 1 cos0 1 b 4 sin 2 9icos 2 9i 

—bsindi —Xxbsin0i — b 2 sin 2 6icos9x —^b 2 sin8iCos$i — Xib 2 sin$iCos$i C 

JcosOi Xibcos$i-\-b 2 coa 2 9x Xl/2\bcos$i -\-Xib 2 cos 2 9i +2b s sin 2 8 1 cos 2 9i B , 

[5.22] 

where C = = £*-bsin9i — ¥r?~b 2 sin9 1 cos6i and B — ¥j-bcos9 1 + ¥j-cos 2 9 1 J i-Xi2b i sin 2 9 1 cos 2 9 1 + 



^^\ 



(5.23) 



b i sin 2 1 cos 2 9i. Dividing the matrix by factors common to rows, this becomes 

-1 bcos9i \ 

-1 bcosOi —2b 2 sin 2 9i 6 3 sin 2 9\Cos9\ 

-1 -X 1 -bcos9 l —Xl/2\—Xibcoa$i —X\/3\ -X 2 /2\bcos9i 

U X 1 + bcos9 1 X 2 /2l+X l bcos0 1 +2b 2 sin 2 9 1 cos9 1 V ' J 

where V = ^f + ?£bcos9 l + X x 2b 2 sin 2 0icos9i -f b s ain 2 9icos9i. By adding and subtracting 
rows, this reduces to 

(—1 bcos0! \ 

— 2b 2 sin 2 9i b s sin 2 9 1 cos6 1 \ — n (k oa\ 

~X X - 2bcos9 l ~X 2 /2\ - X l bcos9 1 —X\ /3! - X 2 /2\bcos9 1 I ~ * ' 

2b 2 sin 2 9icos9i S J 

where S = Xi2b 2 sin 2 1 cos9i + b 3 sin 2 0icos9 1 . Thus, the equation becomes (removing 
common factors) 

(X 1 + 2bco S 1 )\~l $i b 2Xi + b \~0 (5.25) 

and can be expressed as 

• (Xi + 2bcos9 1 )(2X 1 + 6 + bcosO^) = (5.26) 

/"■v Hence, X x = — 2bcos9x remains a root for the n = 2 case. 

We turn now to another example and an alternative approach to the problem of determining 
the image from the zero-crossings across scales. Let the signal be a third order polynomial. 



= 
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/*""\ F{X) = A + BX + CX 2 + X 3 (5.27) 

If we know that the signal is a third order polynomial we can determine its coefficients by 
derivatives of the zero-crossing contours at a single point. It is straightforward to show that 
this gives 

E{X, t) = A + BX + CX 2 + X 3 + 2(C + 3X)t (5.28) 

The zero crossings curves are given by 

A + BX + CX 2 +X 3 + 2(C + 3X)t = (5.29) 

We will show that by taking a sufficient number of derivatives at one point it is possible to 
reconstruct the signal. From (5.29), we calculate 

B + 2CX + 3X 2 + 6t + 2{C + ZX)^- = (5.30) 

dx " 

2C + 6X + 2{C + 3X)^ + 12-^ = (5.31) 

dx 2 dx 

d 2 t d 3 t 

^^s^+^+^fe^ (5 - 32) 

At a point X t, $l, 0, are known. We write (5.29), (5.30), (5.31) as equations in the 
f*\ unknowns A, B, C. 

'1 X X 2 + 2t \(A\ f-X 3 -6Xt\ 

1 -2X + 2& fl = -3X 2 -6i (5.33) 

,0 2 + 20 j\c) \-6X-12fJ 

It will be possible to solve these equations uniquely for A, B, and C, provided the determinant 
of the matrix on the left hand size is nonzero. But the matrix is the Wronskian of the functions 
1, X, X 2 + 2t. Except for a set of measure zero, which we discard, it will only vanish if 
the functions 1, X, X 2 + 2t are linearly dependent. But from (5.29) we see this can only 
happen if the function (C + 3X) divides the function (A + BX + CX 2 + X 3 ). Apart from 
this special case, the determinant of the matrix will be non-zero and it is possible to solve 
for A, B and C. 

We now consider the special case. The condition that (C+3X) divides (A+BX+CX 2 +X 3 ) 
is 

b-% + % MO 

and the result is 

Note firstly that although for the general third order polynomial (5.29) there are usually three 
zero crossing curves, there are now only two. Secondly, this equation is of similar form to 
equation (5.4) for the second order polynomial but ihe relative coefficients of a 2 and X 2 are 
different, so the two cases can be distinguished. 
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We can differentiate (5.35) and show that the coefficients A and C can be determined at a 
f> single point. 

It seems likely that this result will apply to all polynomials functions F(X). Hence knowledge 
of the degree of the polynomial signal allows reconstruction from derivatives at a single 
point. It is furthermore likely that the degree of the image could be determined by the shape 
of the zero-crossing contours. If this conjecture is true this would represent an alternative 
constructive proof of Theorem 1 . 

6. Conclusions 

We conclude with a brief discussion of a few issues that are raised by this paper and that 
will require further work. 

a)Stability of the reconstruction. Although we have not yet rigorously addressed the question 
of numerical stability of the whole reconstruction scheme, there seem to be various ways for 
designing a robust reconstruction scheme. The first step to consider is the reconstruction 
of the filtered signal E{x,t). One could exploit the derivatives at n points - at the given cr - 
and then solve the resulting highly constrained linear equations with least squares methods. 
Alternatively, it may be possible to fit a smooth curve through several points on one contour, 
and then obtain the derivatives there in terms of this interpolated curve. The same process 
must be performed on a second separate zero-crossing contour. This scheme provides a 
rigorous way of proving that instead of derivatives at two points, the location of the whole 
zero-crossing contour across scales can be used directly to reconstruct the signal (since 
the Implicit Function theorem shows that the zero-crossing curve is C°°). 

The second step involves the reconstruction of the unfiltered signal I(x). We have 
r^ constructed V 2 J explicitly. The construction is in terms of Hermite polynomials which 

can be integrated up straightforwardly to give us I (up to a function <f> such that V 2 = 0). 
Alternatively we can consider F(x) to be the second moment of I{x) (see equation (3.2.7)) 
and then use the moment equations to determine the second and higher order moments of 
I(x) leaving the first two moments undetermined. This reconstruction step is unstable, as 
we discussed earlier, if only one scale is used. I(x) can of course be reconstructed only 
modulus the null space of the (differential) operator. When the differential operator is the 
Laplacian and E(x,t) is available for all t, then the representation is invertible and I(s) can 
be recovered. 78 

b) Degenerate fingerprints. Our uniqueness result applies to almost all signal: a restricted 
but well known class of signals, with vertical zero-crossings in the scale-space diagram, 
correspond to nonunique fingerprints. These signals, which will be discussed in a forthcom- 
ing paper [Yuille and Poggio 1983, in preparation], do not belong to the class P introduced 
in Theorem 1 and 2. Interestingly, level-crossings (with a level different from zero) can 
distinguish between elements of this class. Note that there is a further, obvious constraint 
on the reconstruction: the original signal I(x) can be reconstructed modulus the null space 
of the (differential) filter. 

c) Extensions. Our main results are not restricted to second derivatives. They apply to zero- 
and level- crossings of a signal filtered by a gaussian filter of variable size. They also apply 
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7 This reconstruction scheme may play a role in the computation of lightness in the vertebrate visual 
system, (Poggio, possibly in preparation). 

8 Notice that it may often be possible to assume that the image is an analytic entire function, i.e., a 
distribution already "diffused" by the imaging process. In this case, the Hermite expansion converges 
analytically everywhere and so does the associated Taylor expansion. If the convergence, however, 
can only be ensured in Lr (i.e., the image is not analytic) there may be some parts of the image where 
the series expansion is not a faithful representation. We conjecture that it should usually be possible 
to infer the presence of such an anomalous region from the behavior of the derivatives of the image. 
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to transformations of a signal under a linear space-invariant operator - in particular they 
/"*% apply to the linear derivatives of a signal and to linear combinations of them. In both 1-D 

and 2-D, local information at just two points is sufficient. In practice, since many derivatives 
are needed at each point, information about the whole contour, to which the point belongs, 
is in fact exploited. 

d) Are the fingerprints redundant? The proof of our theorem implies that two points on 
the fingerprint contours are sufficient. As we mentioned earlier, several points are probably 
required to make the reconstruction robust. We conjecture, however, that the fingerprints 
are redundant and that appropriate constraints derived from the process underlying signal 
generation (the imaging process in the case of images) should be used to characterize how 
to collapse the fingerprints into more compact representations. Witkin made already this 
point and discussed various heuristic ways to achieve this goal. 

e) Implications of the results. As we discussed in the introduction, our results imply that 
the fingerprint representation is a complete representation of a signal or an image. Zero- 
and level-crossings across scales of a filtered signal capture full information about it. These 
results also suggest a central role for the gaussian in multiscale filtering that assure that 
zero- and level-crossing indeed contain full information. Note, however, that the fingerprint 
theorems do not constrain or characterize in any way the differential filter that has to 
be used. The filter may be just the identity operator, provided of course that enough 
zero-crossings contours exist. Independent arguments, based on the constraints of the 
signal formation process, must be exploited to characterize a suitable filter for each class 
of signals. For images, second derivative operators such as the Laplacian are suggested by 
work that takes into account the physical properties of objects and of the imaging process 
(Grimson, 1982; Poggio and Torre.in preparation; Yuille, 1983). We plan to explore this 
approach in the near future. 
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Appendix 1 



Properties of Hermite polynomials and truncation of the expansion 

The set of Hermite functions is defined by 



V-n(z) = , [1] 

where H n are the Hermite polynomials. 

H n ( X ) = (-ire*°£;e-* 2 [2] 

The Hermite functions are an orthonormal basis of functions which is complete for L 2 
functions. The completeness is expressed by 

X>»f»tf»(?) = *(*-f) [3] 

n 

and the orthonormality by 



/ 



Tpn{x)i> m (x)dx = S nm [4] 



p^ In general, the Hermite expansion of a L 2 function does not converge uniformly, but only in 

the L 2 norm. The series will converge to the function except at a set of point of measure 
zero. At any point, the series can be truncated at a term of order N such that the remainder 
of the series is arbitrarily small. If we only consider a finite number of points where the. 
series converges, the series can be truncated and the function approximated arbitrarily well 
by a finite number of Hermite components. 

The Hermite polynomials defined in equation [2] and the set of function w n (x) defined as 
(see equation 3.2.6): 

»»(*) = — 771 £; e ~ x ' [5] 

1 n n\sfn ax 
are biorthogonal sets of functions, i.e., 



/ 



H n [x)w m (x)dx = S nm [6] 

They also obey a completeness property 

£ff„(a>„(f) = *(*-?) . . [7] 

nm 

and therefore a L 2 function f(x) can be expanded in either set of functions as 

fi X ) = ]C b n w 4 x ) 
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with 

O-n ~ (f, Wn) 



bn = (f,H n ) [9] 



Appendix 2 

Analytic properties of solutions of the diffusion equation 

For completeness we provide results about the analytic properties of functions convolved 
with the gaussian, i.e. solutions of the heat equation with the Huygens property (see later). 
Notice that images can be considered to have undergone already a "diffusion", since the 
imaging process has the effect of convolving the light distribution with a point spread 
function, usually very close to a gaussian. 

Lemma: The solutions of the diffusion equations u(x,t) as functions of x for a given t are 
restrictions to reals of functions which are entire functions of the complex variable (Widder, 
1975, page 64). 9 

This result is noteworthy. The condition that u xx = u t automatically brings with it C°° for 
u(x,t) and even analyticity for the space variable x. Considered as a function of t, u(x,t) can 
be extended analytically into the complex plane, although it will not generally be analytic 
(see Widder, 1975, page 65). 

F{x, cr) — ]T 0n (i, o)v n {x, a) 

n 

The heat polynomials v n are defined as the coefficients of £}■ in the expansion of 

e"-*' 1 = £>„(*,*)£ [1] 



n=0 



where t = \. v n is a polynomial of degree n and is given by 

I "/ 2 1 t k x n—2k 



They are related to the Hermite polynomials H n by 

Vn {x,t) = {-tT^H n (-^—\ [3] 

The heat polynomials are solutions of the diffusion equation. Among other nice properties, 
they obey the following theorem [Widder, 1975]. 

Theorem: Any function u{x,t) which obeys the diffusion equation and has the Huygens 
property can be expanded in a series of heat polynomials which converges uniformly in 

(M)- 

9 Entire functions are functions which are analytic everywhere. 
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A solution u(x, t) of the diffusion equation is said to have the Huygens property if it can be 
f*\ expressed as the convolution of the Gaussian with its initial value at t — 0. Filtered images 

satisfy this requirement by definition. 

This theorem is important since it ensures that the expansion converges not only in the 
square integrable norm, as is usually the case, but also uniformally (i.e., at each point). This 
ensures that undesirable behavior, like the Gibbs phenomenon, does not end. 



Appendix 3 



f~s 



<^*\ 



Convergence of change of basis 
We can write F[x) in terms of the 6„'s as 






n=0 



This series converges in the L 2 sense: given an e > 0, however small, it is possible to find 
an Ni such that 

J ( F ( x ) - Y, M*K(s + *i,*)J dx < e. (2) 

Using (1) we can write equation (2) as 

/( X) b n {t)tp n (x + x u t)\dx<e. (3) 

Similarly for the expansion of F(x) in terms of a n 's we can find an N 2 such that 

/ (f(z) - E 6 »(*)^n(*, <)) dx < e - ( 4 ) 

Set N = max(Ni,N 2 ). If we can cut off the series for F(x) at N then we can change the 
basis, as in subsection 3.3.1. , equate coefficients of the <p n (x,t)'s and hence relate the o„,s 
to the 6„'s. We would then have N equations for the first N moments. We now show that 
cutting off the series is permissible: if we choose e sufficiently small we can make the error 
involved as small as we like. 

The o„'s are related to the 6„'s by 

\n=0 / 

This can be written as 

a n(t) = (^b n (t)<p(x + Xi,t),w n (z,t)y+( E b n (t)<p(x + xi,t),w n (x,t)y (6) 

\n=0 / \n=JV-M / 
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The second term is called s„ and is neglected when we cut off the series at N. We must 
^""*> now show that this is justified. We can write its square as 

*l {*) == {J\ E 6 »(*M* + X U t)) Wn (x, t)dx) . (7) 

Using the Cauchy-Schwarz inequality we obtain 
(/( Yl M*M* + *i.*)M*,t)«fcJ < Jvi n {x,tfdxj( £ M*M* + *i»*)) «**• 

(8) 
The first term on the right hand side of (6) is 



r^ 



N 



a n — an = (J2 b n (t)<p(x + x u t), w n (x, t) V (9) 



\n=0 



Hence, using (8) and (3), we have 



o n 2 < e 



ej(w n {x,t)j dx. (10) 

Thus if we make e very small the errors o„'s will be negligible (we can scale w n {x,t) and 
<p n {x,t) by functions of n so that /( w n (x,t)\ dx tends to a finite limit as n tends to oo; 

alternatively, note that both ajx, t) and a n — a n depend linearly on w n (x, t) and so scaling 
it will not alter their relative sizes). 

The errors involved in terminating the series can be made arbitrarily small by making the 
cutoff N sufficiently large. Thus we can change the basis and obtain N equations for the 
first N moments. We solve these equations and obtain the first N terms in the expansion 
of F(x) in terms of the <p„{x, t). Taking the limit as N tends to oo we reconstruct the image 
(in the L 2 sense). 



Appendix 4 



We will show that the 2n th order determinant is generally non-zero. Recall that the 
determinant is a polynomial in x x (of degree at most 2n) with the coefficients being functions 
of the first n derivation of the curves at the two points. If this determinant always vanished, 
it would mean that the distance between any two curves with prescribed values of their first 
n derivation could only take a finite set of values (at most 2n) whatever the values of the 
higher order derivation of the curves. We will show that, by changing the values of the 
higher order derivatives, it is possible to alter the value of X x continuously while keeping 
the first n derivation of the curves constant. 

We take two points (0, t t ) and (x u h) lying on zero-crossing curves. At these points, 

•we assume we know the derivatives §f, |f, £§, ... up to order n. (This means we 

can reconstruct $?,...,£-£ from the implicit function theorem.) We can use the diffusion 
equation to write these as |f, 0, . . ., %££. 
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So we have 



and 



^(0,t 1 ) = 
dE 
dx K u (i) 



S(*i,*i) = 

a^ (ll ' il) = Cl (2) 5 

a 2n s 



where K 1 ,...,K 2n and Ci,...,C 2n are specified. Now we will try to alter the value of ii 
while keeping K u ...,K 2n and C u ...,C 2n constant. 

We have ' 

E{x,t) = J e iwi e- w2t a; 2 /(w)dw (3) 

Introduce a "deformation" parameter X and a function Y{u,\) where 

r(w,0)-w 2 /(o;) (4) 

and xi = xi(\). 
Let 



£(s, t, X) = / e ,WI e- w2t y(w, \)du 
Allow a;i(X) to vary while maintaining equations (1) and (2). For the first point this gives 

f e~ u ' l ^-Y{u,\)du^=0 



(5) 



r by •" (6) 

e-" 2t u 2n ~{u,\)du = 
J oX 



For the second point we obtain 



dx 
~d\ 

dx\ 

~d\ 



w J oX 

J e iux i e -» at (i<,,)w* n Y{u, \)du + y e'^e-" 8 V n J-Y(w, X)dw = 



(7) 



We want to solve equations (6) and (7) tor §£(w,X) in terms of ^. Then the result follows. 

Equation (6) implies that the first 2n moments of f£(w,X) are zero. Equation (7) means that 
the first 2n moments of e iwIJ ^(w,X) take prescribed values. (We assume Y(w,X) is known 
but not &Y(w,X).) 
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f~\ 



/"*\ 



(8) 



Expanding e tulXi as a Taylor series (and using equation (6)), we write equation (7) as 

v.m==2n-|-l ) 

The moments of ^y(w, X) are 

W TO = J ^^H". ^ m rfw (9) 

and define 

A p = =Ji / e iwi1 e- w, '(iwyy(w, X)dw (10) 

oX J 

Using (9) and (1 0) we rewrite equations (8) as 



{i Xl y 



J2 ^fw m = Al 

^■^ ml 



(11) 



m=2n-4-l v / 

It will always be possible to solve these equations for W m and there will be infinitely many 
solutions. To see this, we set 



W m = ,m>4n + l (12) 



and write equation (11) as 



(2n+l)! '•• (4n+l)! »' VT2n + 1 



\ lF ••• 21T1 / 




(13) 



It is possible to solve (13) if the determinant is non-zero. The determinant is of form 
X(ii) (2 " +i ) 3 . (This follows directly from the form of the matrix) and so is either zero 
for all xi or else never zero. The determinant is also the Wronskian of the function 
('^j' — , ..., ^4n + "i)! and as these functions are linearly independent, it cannot vanish 
everywhere. Hence the determinant never vanishes and we can solve for the W m 's in terms 
of the A p 's. Relaxing the condition (12) gives us infinitely many solutions. 

Thus, we have shown that it is possible to alter x t continuously without changing the values 
of the first n derivatives at both points. This means that the determinant of the 2n-order 
matrix in the moments will in general be non-zero; it can only be zero for a finite set of %\ 
and there are an infinite set of possible values for % x compatible with the first n derivatives 
at the points. 
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